Team Functioning and Performance in Child Advocacy Center Multidisciplinary Teams.

The quality of teamwork in Child Advocacy Center (CAC) multidisciplinary teams is likely to affect the extent to which the CAC model improves outcomes for children and families. This study examines associations between team functioning and performance in a statewide sample of CAC teams. Multidisciplinary team members (N = 433) from 21 CACs completed measures of affective, behavioral, and cognitive team functioning. Team performance was assessed with three measures: team member ratings of overall performance, ratings of mental health screening/referral frequency, and caregiver satisfaction surveys. Linear mixed models and regression analyses tested associations between team functioning and performance. Affective team functioning (i.e., liking, trust, and respect; psychological safety) and cognitive team functioning (i.e., clear direction) were significantly associated with team members' ratings of overall performance. Behavioral team functioning (i.e., coordination) and cognitive team functioning were significantly associated with mental health screening/referral frequency. Team functioning was not associated with caregiver satisfaction with CAC services. Aspects of team functioning were associated with team members' perceptions of overall performance and mental health screening/referral frequency, but not caregiver satisfaction. Understanding associations between team functioning and performance in multidisciplinary teams can inform efforts to improve service quality in CACs and other team-based service settings.

Advancing research on teams and team effectiveness in implementation science: An application of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework.

Background: Effective teams are essential to high-quality healthcare. However, teams, team-level constructs, and team effectiveness strategies are poorly delineated in implementation science theories, models, and frameworks (TMFs), hindering our understanding of how teams may influence implementation. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework is a flexible and accommodating framework that can facilitate the application of team effectiveness approaches in implementation science. Main Text: We define teams and provide an overview of key constructs in team effectiveness research. We describe ways to conceptualize different types of teams and team constructs relevant to implementation within the EPIS framework. Three case examples illustrate the application of EPIS to implementation studies involving teams. Within each study, we describe the structure of the team and how team constructs influenced implementation processes and outcomes. Conclusions: Integrating teams and team constructs into the EPIS framework demonstrates how TMFs can be applied to advance our understanding of teams and implementation. Implementation strategies that target team effectiveness may improve implementation outcomes in team-based settings. Incorporation of teams into implementation TMFs is necessary to facilitate application of team effectiveness research in implementation science.

Teams and team-level constructs are neglected in implementation theories, models, and frameworks (TMFs). This paper calls attention to the importance of teams in implementation research and practice and provides an overview of team effectiveness research for implementation science. We illustrate how the EPIS framework can be applied to advance our understanding of how teams influence implementation processes and outcomes. We identify future directions for research on teams and implementation, including developing and testing implementation strategies that focus on team effectiveness.

Comparing In-Person and Synchronous Online Training for an Evidence-Based Treatment.

Online trainings in evidence-based treatments (EBT) can be effective platforms and may provide better access to community providers as compared with traditional in-person trainings. However, questions remain as to whether online trainings can achieve similar rates of training engagement and model application to traditional in-person trainings. We compared training engagement and model application (e.g., extent of use, fidelity) between participants attending in-person (n = 127) and synchronous online (n = 277) trainings for an EBT (Alternatives for Families: a Cognitive Behavioral Therapy; AF-CBT). Data were collected through pre- and post-training questionnaires and trainers' records. Chi-square analyses and t-tests were used to test for differences between groups. Engagement regarding attendance at workshops and consultation calls was high for both groups, with no significant differences. A total of 81% and 76% presented at least one case and submitted at least one audio recording of an actual AF-CBT session, respectively. Participants rated the training workshop as high quality (M > 4.5/5), and the consultation calls as medium-to-high quality (M > 4/5) across both modalities, indicating good training engagement. In-person training participants were significantly more likely to submit two or more audio recorded sessions than online training participants. This was the only training requirement outcome that differed between the two groups. In examining model application, there were no significant differences between in-person and online training participants in self-reported delivery of AF-CBT, the number of clients with whom it was implemented, the extent they used the model, or the fidelity with which they delivered it. Both groups reported similar improvements in comfort when working with aggressive families, being directive, and using learning techniques like role plays. Online evidence-based treatment skills training appears to be feasible, efficient, and beneficial, with engagement and performance comparable to in-person training. We discuss potential advantages of online training (e.g., fewer costs, greater flexibility for staff from independent practices) and disadvantages (e.g., less satisfaction).

Improving teamwork in multidisciplinary cross-sector teams: Adaption and pilot testing of a team training for Child Advocacy Center teams.

Background: Effective teamwork is critical to the mission of Child Advocacy Center (CAC) multidisciplinary teams. Team interventions designed to fit the unique cross-organizational context of CAC teams may improve teamwork in CACs. Methods: A collaborative, community-engaged approach was used to adapt TeamSTEPPS, an evidence-based team training for healthcare, for CAC multidisciplinary teams. The adapted training was piloted with one team and evaluated using mixed methods. Team members completed pre-training (n = 26) and follow-up surveys (n = 22) and participated in qualitative interviews (n = 9). Results: The adaptation process resulted in the creation of TeamTRACS (Team Training in Roles, Awareness, Communication, and Support). Participants rated TeamTRACS as highly acceptable, appropriate, feasible, relevant, and useful for CAC teams. They identified positive and negative aspects of the training, ideas for improvement, and future uses for TeamTRACS. Conclusions: TeamTRACS is a feasible approach to team training in CACs, and team members find the content and skills relevant and useful. Additional research is needed to test the effectiveness of TeamTRACS and identify appropriate implementation strategies to support its use.

Creating an Interdisciplinary Collaborative Network of Scholars in Child Maltreatment Prevention: A Network Analysis of the Doris Duke Fellowships for the Promotion of Child Well-Being.

Background: Child maltreatment is a complex problem requiring interdisciplinary collaborative research to generate innovative solutions. The Doris Duke Fellowships for the Promotion of Child Well-Being were designed to identify and nurture emerging scholars committed to child maltreatment prevention and create a supportive interdisciplinary learning network. Objective: This paper examines connectivity within the collaborative network created by the fellowships program using longitudinal social network data. Participants and Setting: Participants were 120 individuals selected as Doris Duke Fellows during their doctoral training at universities in the United States. Methods: Fellows completed annual, voluntary web-based surveys to assess their interactions with other fellows during the past year. Social network analysis methods were used to assess the strength and quality of the learning network over a four-year period. Results: Across four years of data, there were increases in the number of connections, proportion of cross-cohort connections, and proportion of interdisciplinary connections. Network analyses showed a highly connected network consisting of primarily medium- and high-quality connections between fellows from different disciplines. The number of scientific journal articles authored by two or more fellows grew substantially over time. Conclusions: Findings indicate the collaborative network created by the fellowships program is growing and strengthening over time. The new Child Well-Being Research Network extends the fellowships network to a broader group of scholars and professionals to advance diversity, equity, inclusion, and justice in the field of child well-being research.

Traumatic stress symptoms and PTSD risk in children served by Children's Advocacy Centers.

Purpose: Children who experience maltreatment are at high risk for posttraumatic stress disorder (PTSD). Children's Advocacy Centers (CACs) can facilitate access to treatment following maltreatment allegations. We describe PTSD symptoms and intervention decision-making for children served by CACs. Methods: Children served by CACs in a single state were screened for PTSD symptoms using a structured mental health screening/referral protocol. CAC staff used an electronic form that provided guidance for decision-making. We examined descriptive statistics for PTSD symptoms and risk and tested associations between child characteristics and symptoms. We described CAC staff's delivery of brief interventions and referral decisions and tested associations with child characteristics and symptoms. Results: Two thousand and three hundred fifty children completed screening between 2018 and 2020. Almost half (45.5%) exhibited traumatic stress symptoms suggesting high probability of PTSD at the time of their CAC visit. Children who identified as female or transgender male and older children were more likely to be at high risk for PTSD. Brief interventions were delivered to 66% of children, and most were referred to evidence-based trauma treatment (53.1%) or community mental health services (39.0%). Categorization as moderate or high PTSD risk was associated with a higher likelihood of brief intervention delivery and referral to trauma treatment. Conclusion: Many children served by CACs are likely to meet criteria for PTSD at their initial visit. CAC staff demonstrated the ability to deliver brief interventions and make referrals to mental health treatment. Use of structured screening/referral protocols may improve early identification and treatment access for children experiencing PTSD symptoms.

Cross-sector collaboration in Project Catalyst: Creating state partnerships to address the health impact of intimate partner violence.

Intimate Partner Violence and Human Trafficking are major public health problems with myriad health and social consequences. This paper describes a federal initiative in the United States to formalize cross-sector collaborations at the state-level and encourage practice and policy changes intended to promote prevention and improve health and safety outcomes for Intimate Partner Violence/Human Trafficking (IPV/HT) survivors. Project Catalyst Phases I and II (2017-2019) engaged six state leadership teams, consisting of leaders from each state's Primary Care Association, Department of Health, and Domestic Violence Coalition. Leadership teams received training and funding to disseminate information on trauma-informed practices to health centers and integrate IPV/HT considerations into state-level initiatives. At the beginning and end of Project Catalyst, participants completed surveys assessing the status of their collaboration and project goals (e.g., number of state initiatives involving IPV/HT, number of people trained). All domains of collaboration increased from baseline to project end. Largest improvements were seen in 'Communication' and 'Process & Structure,' both of which increased by more than 20% over the course of the project. 'Purpose' and 'Membership Characteristics' increased by 10% and 13%, respectively. Total collaboration scores increased 17% overall. Each state made substantial efforts to integrate and improve responses to IPV/HT in community health centers and domestic violence programs, and integrated IPV/HT response into state-level initiatives. Project Catalyst was successful in facilitating formalized collaborations within state leadership teams, contributing to practice and policy changes intended to improve health and safety for IPV/HT survivors.

Team-focused implementation strategies to improve implementation of mental health screening and referral in rural Children's Advocacy Centers: study protocol for a pilot cluster randomized hybrid type 2 trial.

BACKGROUND: Children's Advocacy Centers (CACs) use multidisciplinary teams to investigate and respond to maltreatment allegations. CACs play a critical role in connecting children with mental health needs to evidence-based mental health treatment, especially in low-resourced rural areas. Standardized mental health screening and referral protocols can improve CACs' capacity to identify children with mental health needs and encourage treatment engagement. In the team-based context of CACs, teamwork quality is likely to influence implementation processes and outcomes. Implementation strategies that target teams and apply the science of team effectiveness may enhance implementation outcomes in team-based settings. METHODS: We will use Implementation Mapping to develop team-focused implementation strategies to support the implementation of the Care Process Model for Pediatric Traumatic Stress (CPM-PTS), a standardized screening and referral protocol. Team-focused strategies will integrate activities from effective team development interventions. We will pilot team-focused implementation in a cluster-randomized hybrid type 2 effectiveness-implementation trial. Four rural CACs will implement the CPM-PTS after being randomized to either team-focused implementation (n = 2 CACs) or standard implementation (n = 2 CACs). We will assess the feasibility of team-focused implementation and explore between-group differences in hypothesized team-level mechanisms of change and implementation outcomes (implementation aim). We will use a within-group pre-post design to test the effectiveness of the CPM-PTS in increasing caregivers' understanding of their child's mental health needs and caregivers' intentions to initiate mental health services (effectiveness aim). CONCLUSIONS: Targeting multidisciplinary teams is an innovative approach to improving implementation outcomes. This study will be one of the first to test team-focused implementation strategies that integrate effective team development interventions. Results will inform efforts to implement evidence-based practices in team-based service settings. TRIAL REGISTRATION: Clinicaltrials.gov, NCT05679154 . Registered on January 10, 2023.

Associations between teamwork and implementation outcomes in multidisciplinary cross-sector teams implementing a mental health screening and referral protocol.

PURPOSE: Teams play a central role in the implementation of new practices in settings providing team-based care. However, the implementation science literature has paid little attention to potentially important team-level constructs. Aspects of teamwork, including team interdependence, team functioning, and team performance, may affect implementation processes and outcomes. This cross-sectional study tests associations between teamwork and implementation antecedents and outcomes in a statewide initiative to implement a standardized mental health screening/referral protocol in Child Advocacy Centers (CACs). METHODS: Multidisciplinary team members (N = 433) from 21 CACs completed measures of team interdependence; affective, behavioral, and cognitive team functioning; and team performance. Team members also rated the acceptability, appropriateness, and feasibility of the screening/referral protocol and implementation climate. The implementation outcomes of days to adoption and reach were independently assessed with administrative data. Associations between team constructs and implementation antecedents and outcomes were tested with linear mixed models and regression analyses. RESULTS: Team task interdependence was positively associated with implementation climate and reach, and outcome interdependence was negatively correlated with days to adoption. Task and outcome interdependence were not associated with acceptability, appropriateness, or feasibility of the screening/referral protocol. Affective team functioning (i.e., greater liking, trust, and respect) was associated with greater acceptability, appropriateness, and feasibility. Behavioral and cognitive team functioning were not associated with any implementation outcomes in multivariable models. Team performance was positively associated with acceptability, appropriateness, feasibility, and implementation climate; performance was not associated with days to adoption or reach. CONCLUSIONS: We found associations of team interdependence, functioning, and performance with both individual- and center-level implementation outcomes. Implementation strategies targeting teamwork, especially task interdependence, affective functioning, and performance, may contribute to improving implementation outcomes in team-based service settings.

Implementation of A Care Process Model for Pediatric Traumatic Stress in Child Advocacy Centers: A Mixed Methods Study.

Child Advocacy Centers (CACs) are well-positioned to identify children with mental health needs and facilitate access to evidence-based treatment. However, use of evidence-based screening tools and referral protocols varies across CACs. Understanding barriers and facilitators can inform efforts to implement mental health screening and referral protocols in CACs. We describe statewide efforts implementing a standardized screening and referral protocol, the Care Process Model for Pediatric Traumatic Stress (CPM-PTS), in CACs. Twenty-three CACs were invited to implement the CPM-PTS. We used mixed methods to evaluate the first two years of implementation. We quantitatively assessed adoption, reach, and acceptability; qualitatively assessed facilitators and barriers; and integrated quantitative and qualitative data to understand implementation of mental health screening in CACs. Eighteen CACs adopted the CPM-PTS. Across CACs, screening rates ranged from 10% to 100%. Caregiver ratings indicated high acceptability. Facilitators and barriers were identified within domains of the Consolidated Framework for Implementation Research. Qualitative findings provided insight into adoption, reach, and caregivers' responses. Our findings suggest screening for traumatic stress and suicidality in CACs is valued, acceptable, and feasible. Implementation of mental health screening and referral protocols in CACs may improve identification of children with mental health needs and support treatment engagement.

Effects of Training on Use of Stimulant Diversion Prevention Strategies by Pediatric Primary Care Providers: Results from a Cluster-Randomized Trial.

Pediatric primary care is a promising setting for reducing diversion of stimulant medications for ADHD. We tested if training pediatric primary care providers (PCPs) increased use of diversion prevention strategies with adolescents with ADHD. The study was a cluster-randomized trial in 7 pediatric primary care practices. Participants were pediatric PCPs (N = 76) at participating practices. Practices were randomized to a 1-h training in stimulant diversion prevention or treatment-as-usual. At baseline, 6 months, 12 months, and 18 months, PCPs rated how often they used four categories of strategies: patient/family education, medication management/monitoring, assessment of mental health symptoms/functioning, and assessment of risky behaviors. They completed measures of attitudes, implementation climate, knowledge/skill, and resource constraints. Generalized Estimating Equations estimated differences in outcomes by condition. Mediation analyses tested if changes in knowledge/skill mediated training effects on strategy use. PCPs in the intervention condition reported significantly greater use of patient/family education strategies at all follow-up time points. There were no differences between conditions in medication management, assessment of mental health symptoms/functioning, or assessment of risky behaviors. At 6 months, PCPs in the intervention condition reported more positive attitudes toward diversion prevention, stronger implementation climate, greater knowledge/skill, and less resource constraints. Differences in knowledge/skill persisted at 12 months and 18 months. Brief training in stimulant diversion had substantial and enduring effects on PCPs' self-reported knowledge/skill and use of patient/family education strategies to prevent diversion. Training had modest effects on attitudes, implementation climate, and resource constraints and did not change use of strategies related to medication management and assessment of mental health symptoms/functioning and risky behaviors. Changes in knowledge/skill accounted for 49% of the total effect of training on use of patient/family education strategies. Trial registration This trial is registered on ClinicalTrials.gov (NCT03080259). Posted March 15, 2017.

Public policy and parent-child aggression: Considerations for reducing and preventing physical punishment and abuse.

Parent-child physical aggression, including both physical punishment and abuse, remains a prevalent problem in the United States. In this paper, we briefly review the prevalence and harms of parent-child aggression and discuss changes in social norms and policies over the past several decades. Then, we discuss broad social policies influencing risk for parent-child physical aggression, policies relevant to reducing and preventing physical abuse, and policies relevant to reducing and preventing physical punishment. We close by considering future directions to strengthen research and evaluation and accelerate progress toward ending parent-child physical aggression.

Care team and practice-level implementation strategies to optimize pediatric collaborative care: study protocol for a cluster-randomized hybrid type III trial.

BACKGROUND: Implementation facilitation is an effective strategy to support the implementation of evidence-based practices (EBPs), but our understanding of multilevel strategies and the mechanisms of change within the "black box" of implementation facilitation is limited. This implementation trial seeks to disentangle and evaluate the effects of facilitation strategies that separately target the care team and leadership levels on implementation of a collaborative care model in pediatric primary care. Strategies targeting the provider care team (TEAM) should engage team-level mechanisms, and strategies targeting leaders (LEAD) should engage organizational mechanisms. METHODS: We will conduct a hybrid type 3 effectiveness-implementation trial in a 2 × 2 factorial design to evaluate the main and interactive effects of TEAM and LEAD and test for mediation and moderation of effects. Twenty-four pediatric primary care practices will receive standard REP training to implement Doctor-Office Collaborative Care (DOCC) and then be randomized to (1) Standard REP only, (2) TEAM, (3) LEAD, or (4) TEAM + LEAD. Implementation outcomes are DOCC service delivery and change in practice-level care management competencies. Clinical outcomes are child symptom severity and quality of life. DISCUSSION: This statewide trial is one of the first to test the unique and synergistic effects of implementation strategies targeting care teams and practice leadership. It will advance our knowledge of effective care team and practice-level implementation strategies and mechanisms of change. Findings will support efforts to improve common child behavioral health conditions by optimizing scale-up and sustainment of CCMs in a pediatric patient-centered medical home. TRIAL REGISTRATION: ClinicalTrials.gov, NCT04946253 . Registered June 30, 2021.

Team functioning and implementation of innovations in healthcare and human service settings: a systematic review protocol.

BACKGROUND: Healthcare and human services increasingly rely on teams of individuals to deliver services. Implementation of evidence-based practices and other innovations in these settings requires teams to work together to change processes and behaviors. Accordingly, team functioning may be a key determinant of implementation outcomes. This systematic review will identify and summarize empirical research examining associations between team functioning and implementation outcomes in healthcare and human service settings. METHODS: We will conduct a comprehensive search of bibliographic databases (e.g., MEDLINE, PsycINFO, CINAHL, ERIC) for articles published from January 2000 or later. We will include peer-reviewed empirical articles and conference abstracts using quantitative, qualitative, or mixed methods. We will include experimental or observational studies that report on the implementation of an innovation in a healthcare or human service setting and examine associations between team functioning and implementation outcomes. Implementation outcomes of interest are acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, and sustainability. Two reviewers will independently screen all titles/abstracts, review full-text articles, and extract data from included articles. We will use the Mixed Methods Appraisal Tool to assess methodological quality/bias and conduct a narrative synthesis without meta-analysis. DISCUSSION: Understanding how team functioning influences implementation outcomes will contribute to our understanding of team-level barriers and facilitators of change. The results of this systematic review will inform efforts to implement evidence-based practices in team-based service settings. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42020220168.

An equivalence analysis of provider education in youth mental health care.

OBJECTIVE: To test for equivalence between providers with and without advanced degrees in multiple domains related to delivery of evidence-based treatment. DATA SOURCE: Provider and client data from an effectiveness trial of Alternatives for Families: A Cognitive Behavioral Therapy (AF-CBT) in a major metropolitan area in the United States. STUDY DESIGN: We tested for equivalence between providers (N = 182) with and without advanced degrees in treatment-related knowledge, practices, and attitudes; job demands and stress; and training engagement and trainer-rated competence in AF-CBT. We also conducted exploratory analyses to test for equivalence in family clinical outcomes. DATA COLLECTION: Providers completed measures prior to randomization and at 6-month follow-up, after completion of training and consultation in AF-CBT. Children and caregivers completed assessments at 0, 6, 12, and 18 months. PRINCIPAL FINDINGS: Providers without advanced degrees were largely non-inferior to those with advanced degrees in treatment-related knowledge, practices, and attitudes, while findings for job demands and stress were mixed. Providers without advanced degrees were non-inferior to providers with advanced degrees in consultation attendance (B = -1.42; confidence interval (CI) = -3.01-0.16; margin of equivalence (Δ) = 2), number of case presentations (B = 0.64; CI = -0.49-1.76; Δ = 2), total training hours (B = -4.57; CI = -10.52-1.37; Δ = 3), and trainer-rated competence in AF-CBT (B = -0.04; CI = -3.04-2.96; Δ = 4), and they were significantly more likely to complete training (odds ratio = 0.66; CI = 0.10-0.96; Δ = 30%). Results for clinical outcomes were largely inconclusive. CONCLUSIONS: Provider-level outcomes for those with and without advanced degrees were generally comparable. Additional research is needed to examine equivalence in clinical outcomes. Expanding evidence-based treatment training to individuals without advanced degrees may help to reduce workforce shortages and improve reach of evidence-based treatments.

Use of Stimulant Diversion Prevention Strategies in Pediatric Primary Care and Associations With Provider Characteristics.

PURPOSE: Diversion of stimulant medications for ADHD is a prevalent problem. Pediatric primary care providers (PCPs) are well-positioned to reduce diversion risk among adolescents prescribed stimulants, but little is known about their use of prevention strategies. The objectives of this study were to describe the frequency with which pediatric PCPs use diversion prevention strategies and examine potential determinants (facilitators and barriers) of strategy use. METHODS: Participants were pediatric PCPs (N = 76) participating in a randomized controlled trial of stimulant diversion prevention strategies. At baseline, before randomization, PCPs rated the frequency with which they used specific strategies in each of four categories: patient/family education, medication management/monitoring, assessment of mental health symptoms/functioning, and assessment of risky behaviors. They completed measures of attitudes toward diversion prevention, subjective norms (i.e., implementation climate), and perceived behavioral control (i.e., knowledge/skill, resource constraints). Associations between determinants and strategy use were tested with correlational and regression analyses. RESULTS: PCPs used strategies for assessing mental health symptoms/functioning most frequently and patient/family education strategies least frequently. Attitudes about the effectiveness of diversion prevention, implementation climate, knowledge/skill, and resource constraints were positively correlated with the use of at least one category of strategies. In regression analysis, PCP knowledge/skill was positively associated with patient/family education, medication management, and risk assessment strategies. CONCLUSIONS: Findings suggest that improving knowledge and skill may increase the use of diversion prevention strategies by PCPs. Identifying provider-level determinants of strategy use informs implementation efforts in pediatric primary care and can facilitate efforts to prevent stimulant diversion among adolescents.

Measures of Organizational Culture and Climate in Primary Care: a Systematic Review.

BACKGROUND: Primary care is increasingly contributing to improving the quality of patient care. This has imposed significant demands on clinicians with rising needs and limited resources. Organizational culture and climate have been found to be crucial in improving workforce well-being and hence quality of care. The objectives of this study are to identify organizational culture and climate measures used in primary care from 2008 to 2019 and evaluate their psychometric properties. METHODS: Data sources include PubMed, PsycINFO, HAPI, CINAHL, and Mental Measurements Yearbook. Bibliographies of relevant articles were reviewed and a cited reference search in Scopus was performed. Eligibility criteria include primary health care professionals, primary care settings, and use of measures representing the general concept of organizational culture and climate. Consensus-Based Standards for the selection of health Measurement Instruments (COSMIN) guidelines were followed to evaluate individual studies for methodological quality, rate results of measurement properties, qualitatively pool studies by measure, and grade evidence. RESULTS: Of 1745 initial studies, 42 studies met key study inclusion criteria, with 27 measures available for review (16 for organizational culture, 11 for organizational climate). There was considerable variability in measures, both conceptually and in psychometric quality. Many reported limited or no psychometric information. DISCUSSION: Notable measures selected for frequent use and strength and applicability of measurement properties include the Culture Questionnaire adapted for health care settings, Practice Culture Assessment, and Medical Group Practice Culture Assessment for organizational culture. Notable climate measures include the Nurse Practitioner Primary Care Organizational Climate Questionnaire, Practice Climate Survey, and Task and Relational Climate Scale. This synthesis and appraisal of organizational culture and climate measures can help investigators make informed decisions in choosing a measure or deciding to develop a new one. In terms of limitations, ratings should be considered conservative due to adaptations of the COSMIN protocol for clinician populations. PROSPERO REGISTRATION NUMBER: CRD 42019133117.

Effects of Primary Care Provider Characteristics on Changes in Behavioral Health Delivery During a Collaborative Care Trial.

OBJECTIVE: Pediatric primary care providers (PCPs) are increasingly expected to deliver behavioral health (BH) services, yet PCP characteristics that facilitate or hinder BH service delivery are poorly understood. This study examined how PCP characteristics and collaborative care participation influenced changes in BH-related effort and competency over time. METHODS: Pediatric PCPs (N = 74) participating in a cluster randomized trial (8 practices) of a collaborative care intervention for disruptive behavior problems completed self-report measures at 0, 6, 12, and 18 months. Latent growth curve models tested the impact of PCP characteristics (ie, age, gender, negative BH beliefs, BH burden, BH competency) on changes in identification/treatment of disruptive behavior disorders and competency over the course of the trial. RESULTS: Participation in collaborative care was associated with increases in identification/treatment, with no evidence that PCP characteristics moderated changes in identification/treatment. For competency, however, older PCPs (>50 years) in collaborative care exhibited steep increases over time, while older PCPs in the comparison condition exhibited steep decreases, suggesting differential benefits of collaborative care participation by PCP age. In both conditions, PCPs with more negative BH beliefs reported less identification/treatment over time. Baseline competency was positively associated with identification/treatment and associations weakened over time. Gender and perceived burden had little impact. CONCLUSIONS: PCP characteristics are associated with changes in PCPs' BH-related effort and competency over time. Participation in a collaborative care model appears to be especially beneficial for older PCPs. Implementation of collaborative care can promote growth in BH-related effort and competency for PCPs.